Image processing apparatus, location information adding method

ABSTRACT

An information processing apparatus that acquires captured image data; determines whether a position determining unit of the information processing apparatus detects a location of the information processing apparatus; controls a user interface to prompt a user to enter information when it is determined that a location of the information processing apparatus has not been detected; and receives location information that is extracted based on a user input received at the user interface in response to the prompt.

CROSS-REFERENCES TO RELATED APPLICATIONS

The present application is a continuation application of U.S. patentapplication Ser. No. 15/345,826, filed Nov. 8, 2016, which is acontinuation application of U.S. patent application Ser. No. 14/349,378,filed Apr. 3, 2014, now U.S. Pat. No. 9,509,914, which is a NationalStage Entry of U.S. Patent Application Serial No. PCT/JP2012/006783,filed Oct. 23, 2012, which claims the benefit of priority from priorJapanese Priority Patent Application 2011-253840 filed in the JapanPatent Office on Nov. 21, 2011, the entire contents of which are herebyincorporated by reference.

TECHNICAL FIELD

The present disclosure relates to an image processing apparatus, alocation information adding method, and a program.

BACKGROUND ART

In general, additional information such as date and time information orlocation information during imaging is included in an image captured byan imaging apparatus. The additional information included in the imageas described above is used when a large number of images are managed,for example, in an image management server. More specifically, forexample, the image management server generates a file name based on thedate and time information included in the image, and stores image data.

Here, the following patent literatures (PTLs) 1 to 3 are included astechnology related to the generation of additional information to beincluded in an image.

In PTL 1, technology for selecting one piece of location informationstored in a memory if location information has not been acquired duringthe imaging is disclosed.

In PTL 2, technology for setting location information obtained at adifferent point in time as imaging point information if locationinformation has not been acquired during the imaging is disclosed.

In PTL 3, technology in which an image management server receiving animage from an imaging apparatus generates additional information bysearching a map database using a keyword extracted based on voice orschedule information to be included in the image is disclosed.

CITATION LIST Patent Literature

[PTL 1]

JP 2005-5953A

[PTL 2]

JP 2007-281799A

[PTL 3]

JP 2008-85582A

SUMMARY Technical Problem

However, if no location information has been acquired during theimaging, it is difficult to generate accurate location informationduring imaging thereafter. For example, in the above-described PTL 1,because selection from the location information stored in advance in thememory of the imaging apparatus is performed, location informationdifferent from location information upon imaging is more likely to beselected.

In addition, in the above-described PTL 2, if it is not possible for animaging apparatus to acquire location information for a while such asthat it is not possible to quickly replace a battery after batteryexhaustion inside a car on the move or indoors immediately after themove, there is a problem in that location information acquired by theimaging apparatus at a different point thereafter becomes locationinformation regarding a point completely different from that uponimaging.

In addition, in PTL 3, the case in which it is not possible to acquirelocation information of an imaging point in the imaging apparatus is notconsidered. Further, in PTL 3, because additional information such aslocation information is generated in the image management server, it isnot possible for a user to check an imaging history in real time in themiddle of an outing.

It is desirable to provide a novel and improved image processingapparatus, location information adding method, and program, which enablelocation information of an imaging point to be acquired even when it isdifficult to acquire location information based on an acquisition signalfrom an outside.

Solution to Problem

According to one exemplary embodiment, the disclosure is directed to aninformation processing apparatus comprising: a processor that acquirescaptured image data; determines whether a position determining unit ofthe information processing apparatus detects a location of theinformation processing apparatus; controls a user interface to prompt auser to enter information when it is determined that a location of theinformation processing apparatus has not been detected; and receiveslocation information that is extracted based on a user input received atthe user interface in response to the prompt.

The information processing apparatus may also include an imaging unitthat captures the image data; and the position determining unitconfigured to detect the location of the information processingapparatus based on one or a plurality of received wireless signals,wherein the processor associates the acquired location information withthe captured image data.

According to another exemplary embodiment, the disclosure is directed toa method performed by an information processing apparatus, the methodcomprising: acquiring captured image data; determining whether aposition determining unit of the information processing apparatusdetects a location of the information processing apparatus; controllinga user interface to prompt a user to enter information when it isdetermined that a location of the information processing apparatus hasnot been detected; and receiving location information that is extractedbased on a user input received at the user interface in response to theprompt.

According to another exemplary embodiment, the disclosure is directed toa non-transitory computer-readable medium including computer programinstructions, which when executed by an information processingapparatus, cause the information processing apparatus to perform aprocess comprising: acquiring captured image data; determining whether aposition determining unit of the information processing apparatusdetects a location of the information processing apparatus; controllinga user interface to prompt a user to enter information when it isdetermined that a location of the information processing apparatus hasnot been detected; and receiving location information that is extractedbased on a user input received at the user interface in response to theprompt.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating an outline of a location informationadding system according to the present disclosure.

FIG. 2 is an external appearance diagram of an imaging apparatusaccording to the present disclosure.

FIG. 3 is a block diagram illustrating a configuration of an imagingapparatus according to a first embodiment.

FIG. 4 is a diagram illustrating an example of a timing setting screenof a user's input in a still-image capture mode according to the firstembodiment.

FIG. 5 is a diagram illustrating a display example of a globalpositioning system (GPS) icon according to the first embodiment.

FIG. 6 is a flowchart illustrating a location information adding processaccording to the first embodiment when the timing of the user's input isset to the timing after imaging.

FIG. 7 is a flowchart illustrating a location information adding processaccording to the first embodiment when the timing of the user's input isset to the timing before imaging.

FIG. 8 illustrates an example of a timing setting screen of the user'sinput in a moving-image capture mode according to the first embodiment.

FIG. 9 is a flowchart illustrating a location information adding processaccording to the first embodiment when the timing of the user's input isset to the timing during imaging.

FIG. 10 is a flowchart illustrating a location information addingprocess when the user's input is a character input and the timing of theuser's input is set to the timing after imaging.

FIG. 11 is a diagram illustrating an example of a character group(software keyboard image) displayed on an image display unit.

FIG. 12 is a diagram illustrating an entire configuration of a locationinformation adding system according to a second embodiment.

FIG. 13 is a block diagram illustrating a configuration of an imagingapparatus according to the second embodiment.

DESCRIPTION OF EMBODIMENTS

Hereinafter, preferred embodiments of the present disclosure will bedescribed in detail with reference to the appended drawings. Note that,in this specification and the appended drawings, structural elementsthat have substantially the same function and structure are denoted withthe same reference numerals, and repeated explanation of thesestructural elements is omitted.

Description will be given in the following order.

1. Overview of Imaging Apparatus According to Present Disclosure

2. Embodiments According to Present Disclosure

2-1. First Embodiment

2-2. Second Embodiment

3. Conclusion

Technology according to the present disclosure described herein can beimplemented in various forms as will be described with reference to theabove-described items of “1. Overview of Imaging Apparatus According toPresent Disclosure” and “2. Embodiments According to PresentDisclosure.” In addition, an image processing apparatus 10 according toan embodiment of the present disclosure includes:

(A) a first acquisition unit (a location information acquisition unit19) for acquiring location information based on an acquisition signalfrom an outside,

(B) a second acquisition unit (a voice input unit 28 and a touch panel18) for acquiring location information based on a user's input, and

(C) an addition unit (a control unit 15) for adding the locationinformation acquired by the first acquisition unit to a captured image,

(D) wherein the addition unit adds the location information acquired bythe second acquisition unit to the captured image if the locationinformation has not been acquired by the first acquisition unit.

1. Overview of Imaging Apparatus According to Present Disclosure

Here, after an outline of the location information adding systemaccording to the present disclosure is described with reference to FIG.1, the overview of the imaging apparatus according to the presentdisclosure will be described with reference to FIG. 2.

FIG. 1 is a diagram illustrating an outline of a location informationadding system according to the present disclosure. As illustrated inFIG. 1, the location information adding system according to the presentdisclosure includes the imaging apparatus 10 and artificial satellites50A to 50C.

The imaging apparatus 10 according to the present disclosure has afunction of imaging an imaging target according to the user's operation.The imaging apparatus 10 has a function of adding location informationindicating an imaging point (a current location of its own apparatus) toa captured image. Hereinafter, the acquisition of the locationinformation by the imaging apparatus 10 according to the presentdisclosure will be described.

The imaging apparatus 10 according to the present disclosure has aglobal positioning system (GPS) receiver (see the location informationacquisition unit 19 illustrated in FIG. 3) for calculating (measuring) acurrent location by receiving navigation messages transmitted from theartificial satellites 50A to 50C. Although capital letters are affixedafter reference numerals as in the artificial satellites 50A to 50C soas to distinguish the artificial satellites in FIG. 1, the artificialsatellites 50A to 50C are collectively referred to as an artificialsatellite 50 when it is not necessary to specifically distinguish eachartificial satellite.

The artificial satellite 50 (GPS satellite) orbits over the earth.Although only the three artificial satellites 50A to 50C are illustratedin FIG. 1, for example, four artificial satellites are located in eachof six orbits and a total of 24 artificial satellites orbit over theearth. In addition, the artificial satellite 50 transmits a navigationmessage including orbital information of the artificial satellite, atransmission time of the navigation message, or the like. A GPS receiverprovided in the imaging apparatus 10 can receive navigation messagestransmitted from three or more artificial satellites, for example, theartificial satellites 50A to 50C, and measure a current location of itsown apparatus based on the received navigation messages.

The imaging apparatus 10 according to the present disclosure can addlocation information measured by the GPS receiver (location informationacquisition unit 19) to the captured image as described above.

However, it is difficult for the GPS receiver to measure a currentlocation in a place in which a radio wave from the artificial satellite50 is interrupted and reflected such as indoors, behind a building,between high-rise buildings, on a narrow road between buildings,underground, or under an elevated railroad. If it is not possible forthe GPS receiver to measure the current location, the imaging apparatus10 according to the present disclosure acquires location informationbased on the user's input. For example, as illustrated in FIG. 1, theimaging apparatus 10 searches a database for a location informationsearch based on a building name or a region name input by the user, andacquires the location information of its own apparatus.

As described above, if the GPS receiver has not acquired the locationinformation, the imaging apparatus 10 according to the presentdisclosure can acquire the location information based on the user'sinput, and add the acquired location information to a captured image.The acquisition of the location information based on the user's inputwill be described in detail with reference to “2. Embodiments.”

Next, the overview of the imaging apparatus according to the presentdisclosure will be described with reference to FIG. 2. FIG. 2 is anexternal appearance diagram of the imaging apparatus 10 according to thepresent disclosure. As illustrated in FIG. 2, the imaging apparatus 10includes various operation units such as a shutter button 21, a modeswitch 22, an audio recording button 23, a menu button 24, an operationlever 25, a determination button 27, a play button 29, and an imagedisplay unit 16 on which the touch panel 18 is stacked.

The shutter button 21 is an operation unit that starts/ends still-imagecapture and moving-image capture. The mode switch 22 is a slide typeoperation unit that switches an imaging mode of the imaging apparatus10. For example, the mode is switched to a still-image capture mode whenthe mode switch 22 is positioned at an upper end, switched to a panoramacapture mode when the mode switch 22 is positioned at the center, andswitched to a moving-image capture mode when the mode switch 22 ispositioned at a lower end.

The audio recording button 23 is an operation unit that starts/stopsvoice recording. The audio recording button 23 according to the presentdisclosure is used by the user to input a place name or a facility nameindicating an imaging place so as to acquire location information.

The menu button 24 is an operation unit for causing the image displayunit 16 to display a setting screen (not illustrated) of a functionavailable during imaging or during playback. If the setting screen isdisplayed by pressing the menu button 24, the user performs varioussetting operations by the operation lever 25 and the determinationbutton 27.

The wheel type operation lever 25 is an operation unit for selecting anitem on the screen. The user can select the item by turning the wheel ofthe operation lever 25 or pressing the wheel in an upward, downward,left, or right direction. The determination button 27 is an operationunit for executing the selected item. The play button 29 is an operationunit that switches the operation mode of the imaging apparatus 10 to astill/moving-image playback mode.

The image display unit 16 displays a screen corresponding to theoperation mode (imaging mode/playback mode) of the imaging apparatus 10.For example, during the imaging mode, a captured screen 40, a batteryicon 42, and a GPS icon 44 are displayed as illustrated in FIG. 2. Thecaptured screen 40 is a screen captured by an imaging lens (notillustrated) provided on a side opposite the side of the image displayunit 16 of the imaging apparatus 10 illustrated in FIG. 2. The batteryicon 42 is an icon indicating the remaining battery power of the imagingapparatus 10. The GPS icon 44 indicates a state of measurement by a GPS.The GPS icon 44 illustrated in FIG. 2 indicates a state in which radiowaves are being received from three or more artificial satellites andlocation information can be acquired (measurement is possible).

As described above, the user can recognize the state of the imagingapparatus 10 according to the battery icon 42 or the GPS icon 44displayed on the image display unit 16. Consequently, for example, ifthe GPS icon indicating that measurement by the GPS is not possible isdisplayed on the image display unit 16, the user can perform a voiceinput for a place name, a facility name, or the like by pressing theaudio recording button 23. Thereby, even when the acquisition oflocation information by the GPS is not possible, the imaging apparatus10 can acquire the location information based on the user's input (here,the voice input as an example).

The overview of the imaging apparatus 10 according to the presentdisclosure has been described above. As described above, the imagingapparatus 10 according to the present disclosure adds locationinformation acquired based on the GPS or the user's input to a capturedimage. Hereinafter, the addition of the location information by theimaging apparatus 10 will be described in detail using a plurality ofembodiments.

2. Embodiments

(2-1. First Embodiment)

The imaging apparatus 10 according to the first embodiment searches adatabase provided in the imaging apparatus 10 based on a region name ora facility name input by the user and acquires location information iflocation information acquisition by the GPS is difficult. Hereinafter,the configuration of the imaging apparatus 10 will be described withreference to FIG. 3.

(Configuration of Imaging Apparatus 10 According to First Embodiment)

FIG. 3 is a block diagram illustrating the configuration of the imagingapparatus 10 according to the first embodiment. As illustrated in FIG.3, the imaging apparatus 10 according to this embodiment includes anoptical component 12, an imaging unit 14, an image display unit 16, thetouch panel 18, an operation unit 20, the control unit 15, the locationinformation acquisition unit 19, a recording unit 26, a voice input unit28, a recording medium 30, and a database 32.

The optical component 12 includes a zoom lens and an imaging lens thatcollect light coming from an object. In addition, the optical component12 is controlled by the control unit 15 according to a zoom operation ofthe user, and a focal length is shortened or lengthened. Thereby, animage of the object formed on the imaging unit 14 is reduced/enlarged.

The imaging unit 14 is a signal conversion unit such as a charge coupleddevice (CCD) or complementary metal oxide semiconductor (CMOS), and theimage of the object is formed by the optical component 12. If the imageof the object is formed on the signal conversion unit, the signalconversion unit converts the image of the object into an electricalimage signal. In addition, the imaging unit 14 is controlled by thecontrol unit 15 according to the user's operation that switches theimaging mode, and outputs an image signal of one of a still image, apanorama, and a moving image to the control unit 15. In addition, theimaging unit 14 outputs the image signal (captured image) subjected tothe conversion to the image display unit 16.

The image display unit 16 can display the captured image converted bythe imaging unit 14 from the image of the object of which the light iscollected by the optical component 12 in the imaging mode. In addition,the image display unit 16 can display an index screen or a playbackscreen in the playback mode.

As an example of an operation display unit, the touch panel 18 isstacked and provided on the image display unit 16 as described above.The user can input various instructions or information to the imagingapparatus 10 by operating the touch panel 18. In addition, the touchpanel 18 according to this embodiment can input characters indicating aregion name or a facility name as the user's input for acquiringlocation information of an imaging point in the still-image, panorama,and moving-image capture modes.

The operation unit 20 includes various operation units (the shutterbutton 21, the mode switch 22, the audio recording button 23, the menubutton 24, and the operation lever 25) described with reference to FIG.2. In FIG. 3, the audio recording button 23 and the operation lever 25are representatively illustrated.

The control unit 15 controls elements provided in the imaging apparatus10. In addition, the control unit 15 executes various controls using arandom access memory (RAM) or a buffer memory as a work area accordingto a control program stored in a read only memory (ROM) as will bedescribed later. In addition, the control unit 15 performs controlcorresponding to the user's operation. For example, the control unit 15according to this embodiment starts recording of voice input from thevoice input unit 28 when the audio recording button 23 has been pressed.In addition, the control unit 15 according to this embodiment can searchthe database 32 based on a region name or a facility name input from thevoice input unit 28 or the touch panel 18, and extract locationinformation from the database 32. Further, the control unit 15 accordingto this embodiment controls the addition of location informationindicating an imaging point to a captured image.

The location information acquisition unit 19 is a first acquisition unitthat acquires location information based on an acquisition signal froman outside. More specifically, the location information acquisition unit19 according to the present disclosure is a GPS receiver that receives anavigation message, which is an example of the acquisition signal fromthe outside, transmitted from the above-described artificial satellite50, and calculates (measures) a current location. In addition, thelocation information acquisition unit 19 outputs the locationinformation indicating the measured current location to the control unit15. In addition, the location information acquisition unit 19 mayacquire the location information constantly (or at regular intervals)while the GPS setting is ON.

The recording unit 26 is a recording medium such as the RAM or ROM. Forexample, the RAM is used as a work area of the control unit 15. Inaddition, for example, a program for controlling the optical component12, the imaging unit 14, and the image display unit 16 or a program forexecuting recording control and playback control of an image signal or avoice signal is written to the ROM.

The voice input unit 28 collects voice around an object in themoving-image capture mode. The voice input unit 28 has a function (voiceprocessing unit) of converting the voice collected by a voice collectionunit (microphone) (not illustrated) into an electrical voice signal. Inaddition, the voice input unit 28 performs a process such as acorrection or automatic gain control (AGC) process for the voice signalbased on a control signal from the control unit 15, and a process ofconverting the voice signal into a digital form. The voice input unit 28according to the present disclosure collects the user's voice as theuser's input for location information acquisition of an imaging point inthe still-image, panorama, and moving-image capture modes. In this case,the voice input unit 28 performs a process of recognizing the collectedvoice signal, converting the recognized voice signal into characterdata, and outputting the character data to the control unit 15 as theuser's input information.

The above-described microphone may be embedded in the imaging apparatus10 or attached to an outer portion.

The recording medium 30 is a memory card to which compressed data of acaptured image encoded by the control unit 15 is written, and the like.In addition, the compressed data of the image read from the recordingmedium 30 is decoded by the control unit 15 and displayed on the imagedisplay unit 16.

The database 32 is a database for a location information search. Morespecifically, the database 32 holds “location information” such aslatitude, longitude, altitude, and an address associated with “names”such as a region name, a building name, a facility name, a proper name,and a common name. Thereby, the control unit 15 can search the database32 based on a name such as a region name input from the user, andextract location information associated with the name.

The configuration of the imaging apparatus 10 according to the firstembodiment has been described above. Next, the timing of the user'sinput for location information acquisition will be described withreference to the drawings.

(Timing Setting of User's Input)

As described above, the imaging apparatus 10 according to thisembodiment adds location information indicating an imaging point to acaptured image. Although the location information added to the capturedimage is usually location information acquired by the locationinformation acquisition unit 19 using the GPS, the imaging apparatus 10acquires location information based on the user's input if the locationinformation acquisition unit 19 has not acquired the locationinformation. For the user's input, the user inputs a region name, abuilding name, or a facility name indicating an imaging point by voice.

The timing of the user's input may be one of timings before the imagingoperation, during the imaging operation, and after the imagingoperation. In addition, the timing of the user's input may be set to oneof the timings described above according to the specs of the imagingapparatus 10, and the user may arbitrarily set one described above. Thecase in which the user arbitrarily sets the timing of the user's inputwill be described with reference to FIG. 4.

FIG. 4 is a diagram illustrating an example of a timing setting screenof the user's input in the still-image capture mode. According to anoperation of the menu button 24 or the like, the control unit 15displays a setting screen 161 on the image display unit 16 asillustrated in FIG. 4. The setting screen 161 includes selection itemsof “before imaging” and “after imaging,” and each selection item can beselected by a radio button. In addition, even in the panorama capturemode in which a plurality of still images are connected to implement apanorama view angle, the timing of the user's input is equally setaccording to a setting screen (not illustrated) including the selectionitems of “before imaging” and “after imaging.” As described above, inthe still-image capture mode and the panorama capture mode (hereinaftercollectively referred to as a still-image capture mode), the timing ofthe user's input can be set after or before the imaging.

In addition, in the moving-image capture mode, the timing of the user'sinput can be set to one of timings before the imaging, during theimaging, and after the imaging. The timing setting of the user's inputin the moving-image capture mode will be described in detail withreference to the “moving-image capture mode” to be described later.

The control unit 15 may display a GPS icon indicating a locationinformation acquisition state of the location information acquisitionunit 19 on the display unit 16 according to the set timing of the user'sinput. Here, a display example of the GPS icon according to thisembodiment is illustrated in FIG. 5.

As illustrated in FIG. 5, if location information acquisition by thelocation information acquisition unit 19 is difficult, for example,because the location information acquisition unit 19 is set to beinactive due to a small battery capacity (see the battery icon 42), theGPS icon 46 indicating this fact is displayed on the image display unit16. More specifically, the GPS icon 46 is displayed before the imagingwhen the timing of the user's input is set to the timing “beforeimaging,” displayed along with an image during the imaging when thetiming of the user's input is set to the timing “during imaging,” anddisplayed along with a captured image when the timing of the user'sinput is set to the timing “after imaging.” Thereby, the imagingapparatus 10 can prompt the user to perform the user's input forlocation information.

The timing setting of the user's input has been described above. Next,the location information adding process of the imaging apparatus 10according to this embodiment will be described.

(Location-Information Adding Process of Imaging Apparatus 10 Accordingto First Embodiment)

The imaging apparatus 10 according to this embodiment adds locationinformation to a captured image based on the user's input if thelocation information acquisition unit 19 has not acquired the locationinformation. Here, the timing of the user's input for acquiring thelocation information is the timing before/after imaging in thestill-image capture mode, and is the timing before/during/after imagingin the moving-image capture mode. Hereinafter, the location informationadding process according to this embodiment will be described in detailaccording to the timing setting of the user's input.

(Still-Image Capture Mode)

Here, the case in which the timing of the user's input is set to thetiming after or before imaging in the still-image capture mode will bedescribed with reference to each flowchart.

After Imaging

FIG. 6 is a flowchart illustrating the location information addingprocess according to this embodiment when the timing of the user's inputis set to the timing after the imaging. As illustrated in FIG. 6, first,in step S102, if the user presses the shutter button 21, the controlunit 15 of the imaging apparatus 10 performs an imaging operation bycontrolling the optical component 12 and the imaging unit 14.

Then, in step S104, the control unit 15 determines whether or notlocation information acquisition by the location information acquisitionunit 19 is possible. Here, the location information acquisition unit 19constantly acquires location information if the GPS setting is ON.Consequently, the control unit 15 determines whether or not the locationinformation acquisition unit 19 is in a state in which the locationinformation acquisition is possible at a point in time immediately afterthe imaging.

Next, if the location information acquisition is determined to bepossible, the control unit 15 acquires the location information by thelocation information acquisition unit 19 in step S106, and subsequentlythe control unit 15 adds the location information to the captured imageand stores the image in the recording unit 26 or the recording medium 30in step S118.

On the other hand, if the location information acquisition is determinednot to be possible in step S104 described above, a voice inputindicating an imaging point is performed, the voice input unit 28recognizes the input voice, converts the recognized voice into characterdata, and outputs the character data to the control unit 15 as theuser's input information in step S108. Here, as described above, thecontrol unit 15 may prompt the user to perform the voice input bydisplaying the GPS icon 46 indicating that the location informationacquisition by the location information acquisition unit 19 is notpossible on the image display unit 16 along with a captured image ordisplaying candidates for an imaging point based on location informationcapable of ultimately being acquired. In addition, for the voice inputby the user, the voice of the user who speaks a region name, a facilityname, or the like indicating an imaging point is input from a microphone(not illustrated), for example, when the audio recording button 23 hasbeen pressed. The control unit 15 may select the location informationcapable of being ultimately acquired as the user's input information.Further, in voice recognition, the voice input based on the locationinformation capable of being ultimately acquired may be recognized andconverted into character data.

Then, in step S112, the control unit 15 searches the database 32 basedon the user's input information output from the voice input unit 28. Instep S114, the control unit 15 extracts location information associatedwith the user's input information (names indicating imaging points suchas a region name and a facility name) from the database 32.

Here, if there are a plurality of pieces of location informationextracted from the database 32, the control unit 15 displays theplurality of pieces of location information on the image display unit16, and allows the user to select one of the plurality of pieces oflocation information in step S116. In addition, if the locationinformation extracted from the database 32 is a region of a broad range,the control unit 15 may perform automatic selection from main placenames of the region, and equally display a plurality of candidates onthe image display unit 16 to allow the user to perform the selection.

Subsequently, in step S118, the control unit 15 adds the locationinformation to a captured image, and stores the image in the recordingunit 26 or the recording medium 30.

The location information adding process when the timing of the user'sinput is set to the timing after the imaging in the still-image capturemode has been described above in detail. Subsequently, the locationinformation adding process when the timing of the user's input is set tothe timing before the imaging in the still-image capture mode will bedescribed with reference to FIG. 7.

Before Imaging

FIG. 7 is a flowchart illustrating the location information addingprocess according to this embodiment when the timing of the user's inputis set to the timing before the imaging. The same processes as in thesteps illustrated in FIG. 6 among steps illustrated in FIG. 7 aredenoted by the same step numerals.

As illustrated in FIG. 7, first, in step S104, the control unit 15determines whether or not location information acquisition by thelocation information acquisition unit 19 is possible. Here, as describedabove, the location information acquisition unit 19 constantly acquireslocation information if the GPS setting is ON. Consequently, the controlunit 15 makes the determination of step S104 at a point in time beforethe imaging, for example, if the operation mode of the imaging apparatus10 has been switched to the imaging mode.

Next, if the location information acquisition is determined to bepossible, the control unit 15 acquires the location information by thelocation information acquisition unit 19 in step S106, and then performsan imaging operation in step S107. In step S118, the control unit 15adds the location information to a captured image, and stores the imagein the recording unit 26 or the recording medium 30.

On the other hand, if the location information acquisition is determinednot to be possible in step S104 described above, a voice inputindicating an imaging point is performed, and the voice input unit 28recognizes the input voice, converts the recognized voice into characterdata, and outputs the character data to the control unit 15 as theuser's input information in step S108. As described above, the controlunit 15 may prompt the user to perform the voice input by displaying theGPS icon 46.

Next, if the user presses the shutter button 21 in step S109, thecontrol unit 15 of the imaging apparatus 10 performs an imagingoperation by controlling the optical component 12 and the imaging unit14.

Subsequently, the control unit 15 performs the same process as in theabove-described steps S112 to S118 illustrated in FIG. 6, and adds thelocation information to the captured image.

The location information adding process when the timing of the user'sinput is set to the timing before the imaging in the still-image capturemode has been described above in detail. Although the voice input instep S108 illustrated in FIGS. 6 and 7 is performed before/after theimaging operation, it is not necessary to constantly perform the voiceinput before/after each imaging operation in the embodiments accordingto the present disclosure. For example, when the imaging is continuouslyperformed or when a plurality of imaging operations are performed in thesame place, the control unit 15 may store location information acquiredbased on the user's input in the recording unit 26, and thereafter mayadd the location information stored in the recording unit 26 to capturedimages for a given time.

(Moving-Image Capture Mode)

Next, the location information adding process in the moving-imagecapture mode will be described. In the moving-image capture mode, it ispossible to set the timing of the user's input to the timingbefore/during/after imaging as described above. First, the timingsetting of the user's input in the moving-image capture mode will bedescribed with reference to FIG. 8.

FIG. 8 is a diagram illustrating an example of a timing setting screenof the user's input in the moving-image capture mode. According to anoperation of the menu button 24 or the like, the control unit 15displays a setting screen 163 on the image display unit 16 asillustrated in FIG. 8. The setting screen 163 includes selection itemsof “before imaging,” “during imaging,” and “after imaging,” and eachselection item can be selected by a radio button. As described above,the user can arbitrarily set the timing of the user's input from thesetting screen 163. Hereinafter, the location information adding processcorresponding to the timing setting of the user's input will bedescribed.

Before/after Imaging

Because the location information adding process when the timing of theuser's input is set to the timing “before imaging” or “after imaging” isthe same as in the above-described still-image capture mode, a briefdescription will be given here. That is, the control unit 15 accordingto this embodiment determines whether or not location informationacquisition by the location information acquisition unit 19 is possiblebefore the start of the imaging/after the end of the imaging. If theacquisition by the location information acquisition unit 19 isdetermined not to be possible, location information is acquired based ona voice input by the user and added to a captured image.

During Imaging

Next, the location information adding process according to thisembodiment when the timing of the user's input is set to the timing“during imaging” in the moving-image capture mode will be described withreference to FIG. 9

FIG. 9 is a flowchart illustrating the location information addingprocess according to this embodiment when the timing of the user's inputis set to the timing during the imaging. The same processes as in thesteps illustrated in FIG. 6 among steps illustrated in FIG. 9 aredenoted by the same step numerals.

As illustrated in FIG. 9, first, in step S103, the control unit 15 ofthe imaging apparatus 10 starts moving-image capture by controlling theoptical component 12 and the imaging unit 14 if the user presses theshutter button 21.

Then, in step S104, the control unit 15 determines whether or notlocation information acquisition by the location information acquisitionunit 19 is possible. Here, the location information acquisition unit 19constantly acquires location information if the GPS setting is ON.Consequently, during the imaging, the control unit 15 determines whetheror not the location information acquisition unit 19 is in a state inwhich the location information acquisition is possible.

Next, if the location information acquisition is determined to bepossible, the control unit 15 acquires location information by thelocation information acquisition unit 19 in step S106, and subsequentlythe control unit 15 adds the location information to a captured imageduring the imaging or after the end of the imaging and stores the imagein the recording unit 26 or the recording medium 30 in step S118.

On the other hand, if the location information acquisition is determinednot to be possible in step S104 described above, the control unit 15performs the same process as in the above-described steps S108 and S112to S118 illustrated in FIG. 6, adds the location information to thecaptured image during the imaging or after the end of the imaging, andstores the image in the recording unit 26 or the recording medium 30.

Here, during the moving-image capture, in addition to the imaging by theimaging unit 14, voice is normally collected constantly from amicrophone (not illustrated). In this embodiment, voice recognition of avoice part determined to be a voice input for acquiring locationinformation is performed in voice collection that is constantlyperformed, and the recognized voice part is output to the control unit15 as the user's input information. In addition, in order to clarify thevoice input for acquiring the location information, for example, thevoice recognition may be started by designating the pressing of theaudio recording button 23 as a trigger, and character data subjected toconversion may be output to the control unit 15 as the user's inputinformation.

The location information adding process when the timing of the user'sinput has been set to the timing during the imaging in the moving-imagecapture mode has been described above in detail.

Although the voice input has been described as an example of the user'sinput in the above-described flowchart, the embodiment according to thepresent disclosure is not limited thereto. For example, the user's inputmay be a character input. Hereinafter, the location information addingprocess according to this embodiment in an example of the characterinput as the user's input will be described with reference to FIGS. 10and 11.

(Acquisition of Location Information Based on Character Input)

FIG. 10 is a flowchart illustrating a location information addingprocess when the user's input is a character input and the timing of theuser's input is set to the timing after imaging. Among steps illustratedin FIG. 10, steps S102, S104, S106, and S112 to S118 are the same as theprocesses denoted by the same step numerals illustrated in FIG. 6.

As illustrated in FIG. 10, in step S110, a character input indicating animaging point is performed. Characters indicating the imaging point are,for example, a region name, a facility name, a building name, and thelike. In addition, for example, a character group may be displayed onthe image display unit 16 as the character input, and input charactersmay be selected and input by the operation lever 25 or the like. Here,an example of the character group (a software keyboard image) displayedon the image display unit 16 is illustrated in FIG. 11.

As illustrated in FIG. 11, the control unit 15 displays a characterinput screen 165 including the software keyboard image and the sentence“Please input a name (region name, building name, or the like)indicating an imaging point” for an input prompt on the image displayunit 16. Because the touch panel 18 is stacked as described above, theimage display unit 16 can also perform character selection when the usertouches the screen.

Based on character data input as described above, the control unit 15checks the database in step S112, and extracts location information instep S114.

The character input according to this embodiment is not limited tocharacter selection from the character group illustrated in FIG. 11. Forexample, the character input may be a handwritten character input fromthe touch panel 18. These functions may be redundantly mounted.

Because the character input as the user's input is also possible asdescribed above, the character input can serve as a comparatively cheapreplacement means even when a function in which the imaging apparatus 10recognizes voice is not mounted. In addition, the user's input can bereliably performed, for example, even in a state in which surroundingnoise is large and a voice input is difficult or a state in which nosound is made, by adding a character input function to the imagingapparatus 10 according to the above-described first embodiment.

The character input, which is an example of the user's input foracquiring location information, has been described above in detail.Next, the timing at which the acquired location information is added toa captured image will be described.

(Acquisition Timing of Location Information)

Although the location information is acquired before an imagingoperation, during the imaging operation, or after the image operation inthe above-described first embodiment, the embodiment according to thepresent disclosure is not limited thereto. For example, if correspondinglocation information has not been extracted from the database 32, thecontrol unit 15 may store a name input by the user or re-perform asearch when a new database is mounted.

(Addition Timing of Location Information)

Although the addition of acquired location information to a capturedimage is illustrated in step S118 of FIGS. 6, 7, and 9 in theabove-described first embodiment, the embodiment according to thepresent disclosure is not limited thereto. For example, the addition ofthe location information to the captured image may be changed to anarbitrary timing after an imaging operation.

For example, when data processing by the control unit 15 is limitedbecause a battery capacity of the imaging apparatus 10 is small, thecontrol unit 15 adds the location information to the captured imageafter the battery capacity is restored.

In addition, when there is not sufficient time to wait for a dataprocessing time after each imaging operation such as continuous imaging,the control unit 15 adds location information to a captured image at atiming set by the user or set by the specs. More specifically, thecontrol unit 15 may add the location information, for example, when apower supply is in a sleep mode.

Thereby, for example, even when battery power is consumed or even whendata processing is time-consuming, the imaging apparatus 10 according tothis embodiment can reliably add the location information to thecaptured image.

As described above, according to the first embodiment, the imagingapparatus 10 acquires the location information based on the user's inputand adds the location information to the captured image when thelocation information acquisition unit 19 has not acquired the locationinformation. Thereby, it is possible to add more accurate locationinformation to a captured image even when the location informationacquisition by the location information acquisition unit 19 is notpossible.

Although the case in which the timing of the user's input is preset inthe above-described first embodiment has been described, the embodimentaccording to the present disclosure is not limited thereto. For example,the user may input voice from the microphone by pressing the audiorecording button 23 at an arbitrary timing. Thereby, for example, theuser can input voice indicating a point when moving to an area in whicha radio wave from the artificial satellite 50 is interrupted such asindoors or between high buildings. In this case, the control unit 15stores location information acquired based on the voice input by theuser in the recording unit 26, and then adds the location informationstored in the recording unit 26 to a captured image for a given time.

In addition, in the above-described first embodiment, although it isdetermined whether or not location information acquisition by the GPS ispossible immediately before the user's input (voice input, characterinput, or the like) as illustrated in step S104, the embodimentaccording to the present disclosure is not limited thereto. For example,even when the timing of the user's input is set to one of timingsbefore/during/after imaging, the control unit 15 determines whether ornot the location information acquisition by the GPS is possible duringthe imaging operation. If the location information acquisition by theGPS is not possible, the control unit 15 may add location informationbased on the user's inputs performed at a time closest to the imagingtime.

In addition, the configuration of the embodiment according to thepresent disclosure is not limited to the configuration illustrated inFIG. 3, and, for example, may be a configuration according to the secondembodiment to be described next.

(2-2. Second Embodiment)

In the second embodiment according to the present disclosure, first, theentire configuration of the location information adding system will bedescribed with reference to FIG. 12. As illustrated in FIG. 12, animaging apparatus 11 according to the second embodiment communicateswith a server 60 while recognizing a base station 64 and a network 62.

The server 60 has a map database in which location information isassociated with various names, extracts corresponding locationinformation according to a request from the imaging apparatus 11, andtransmits the extracted location information to the imaging apparatus11.

Thereby, the imaging apparatus 11 according to this embodiment canacquire corresponding location information from the server 60 whenmaking a location information acquisition request by transmitting theuser's input information (various names indicating an imaging point) tothe server 60. Next, the configuration of the imaging apparatus 11according to this embodiment will be described with reference to FIG.13.

(Configuration of Imaging Apparatus 11 According to Second Embodiment)

FIG. 13 is a block diagram illustrating the configuration of the imagingapparatus 11 according to the second embodiment. As illustrated in FIG.13, the configuration of the imaging apparatus 11 according to thisembodiment is different from that of the above-described firstembodiment in that a communication unit 34 is provided without thedatabase 32 for the location information search.

The communication unit 34 is an interface for communicating with anexternal apparatus, and performs wired or wireless communication. Morespecifically, the communication unit 34 according to this embodimentsends a location information acquisition request to the server 60according to control of the control unit 15. In the location informationacquisition request, the communication unit 34 transmits the user'sinput information. In addition, the communication unit 34 according tothis embodiment acquires location information corresponding to therequest from the server 60.

As described above, because the imaging apparatus 11 according to thisembodiment can acquire location information from an external database,it is possible to acquire more accurate location information even whenthe imaging apparatus does not store the database 32. Although aconfiguration in which the database 32 for the location informationsearch is not provided is illustrated in FIG. 13, the configuration ofthe imaging apparatus 11 according to this embodiment is not limitedthereto. For example, the imaging apparatus 11 according to thisembodiment may be configured to have the database 32 and thecommunication unit 34. In this case, the imaging apparatus 11 acquireslocation information from an external database via the communicationunit 34 when the location information has not been acquired from thedatabase 32. Thereby, the imaging apparatus 11 according to thisembodiment can acquire more appropriate location information.

In addition, although the imaging apparatus 11 communicates with theserver 60 while recognizing the base station 64 and the network 62 inthe entire configuration illustrated in FIG. 12, the entireconfiguration according to this embodiment is not limited thereto. Forexample, the imaging apparatus 11 may be connected to an informationprocessing apparatus such as a personal computer (PC) and acquirelocation information from a database within the information processingapparatus. In addition, the imaging apparatus 11 may be furtherconnected to an external network via the connected informationprocessing apparatus and may acquire the location information from adatabase on the external network.

In this embodiment, content of mutual communication between the imagingapparatus 11 and the server 60 is related to location information, anddoes not include a captured image so as to decrease an amount of datacommunication.

3. Conclusion

As described above, if location information has not been acquired by thelocation information acquisition unit 19 using the GPS, the imagingapparatus 10 according to the present disclosure acquires the locationinformation based on the user's input and adds the acquired locationinformation to a captured image. More specifically, the imagingapparatus 10 acquires corresponding location information from a mapdatabase in which names are associated with location information basedon a name such as a region name, a facility name, or a building nameinput by the user.

Thereby, the imaging apparatus 10 according to the present disclosurecan add appropriate location information of an imaging point to acaptured image even when it is not possible to use the GPS.

In addition, the imaging apparatus 10 has a function of displaying a mapon the image display unit 16 and arranging a previously captured imagein a corresponding position on the map according to location informationadded to the image. However, stress is caused to the user because thelocation information added to the captured image may be erroneouslyarranged due to an error from an actual imaging point. According to theimaging apparatus 10 based on the present disclosure, the captured imageis appropriately arranged on the map because appropriate locationinformation of an imaging point can be added to the captured image evenwhen no GPS is available as described above. Thereby, the user can enjoya history of captured images without stress.

In addition, the imaging apparatus 10 according to the presentdisclosure adds location information to a captured image at a point intime before imaging, during the imaging, or after the imaging. Thereby,it is possible to improve the efficiency of editing because there is nocomplex process of manually re-adding location information when the userarranges captured images and inputs the arranged images to aninformation processing apparatus later.

In addition, according to the imaging apparatus based on the presentdisclosure, usability is improved because the timing of the user's inputcan be arbitrarily set based on the user's preference.

In addition, according to the imaging apparatus based on the presentdisclosure, the user's input for inputting a name such as a region nameindicating an imaging point is implemented, for example, by a voiceinput or a character input. Because the voice input is possible, theuser can easily input the name of the imaging point. In addition,because the character input is possible, the character input can serveas a comparatively cheap replacement means even when no voicerecognition function is mounted in the imaging apparatus. In addition,according to the imaging apparatus based on the present disclosure, thevoice input and the character input may be provided as the user's inputmeans. Thereby, the user's input can be reliably performed, for example,even in a state in which surrounding noise is large and a voice input isdifficult or a state in which no sound is made.

In addition, according to the imaging apparatus based on the presentdisclosure, location information can be acquired from an external mapdatabase. Thereby, it is possible to acquire more appropriate locationinformation and add the location information to a captured image evenwhen it is not possible to store a database due to a recording datacapacity limit of the imaging apparatus or even when locationinformation has not been acquired because only a database of someregions is stored. Content of mutual communication with an external mapdatabase is related to location information, and does not include imageinformation so as to decrease an amount of data communication.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

Although a process in which the control unit 15 determines whether ornot location information acquisition by the location informationacquisition unit 19 is possible, for example, in the above-describedstep S104, before imaging, during the imaging, or immediately after theimaging has been described, the determination method according to thepresent disclosure is not limited thereto. For example, if the locationinformation acquisition by the location information acquisition unit 19is not possible within a given time such as 10 minutes, 30 minutes, orone hour, the control unit 15 according to the present disclosure maydetermine that the acquisition is not possible. A time taken for thedetermination may be arbitrarily set by the specs of the imagingapparatus 10 or by the user.

In addition, the location information acquisition function based on theuser's input provided in the imaging apparatus 10 of this embodiment maybe arbitrarily set to be turned on/off by the user. If the locationinformation acquisition function based on the user's input is OFF, theimaging apparatus 10 may add, for example, most recently acquiredlocation information to a captured image when location information hasnot been obtained using the GPS before/during/after an imagingoperation.

Additionally, the present technology may also be configured as below.

(1) An information processing apparatus comprising: a processor thatacquires captured image data; determines whether a position determiningunit of the information processing apparatus detects a location of theinformation processing apparatus; controls a user interface to prompt auser to enter information when it is determined that a location of theinformation processing apparatus has not been detected; and receiveslocation information that is extracted based on a user input received atthe user interface in response to the prompt.

(2) The information processing apparatus of (1), further comprising: animaging unit that captures the image data; and the position determiningunit configured to detect the location of the information processingapparatus based on one or a plurality of received wireless signals,wherein the processor associates the acquired location information withthe captured image data.

(3) The information processing apparatus of any one of (1) to (2),further comprising: the user interface including a display that displaysthe prompt for the user to enter the information when it is determinedthat the location of the information processing apparatus has not beendetected.

(4) The information processing apparatus of any one of (1) to (3),further comprising: a communication interface that transmits informationcorresponding to the user input to another information processingapparatus, and receives the location information that is extracted bythe another information processing apparatus based on the informationcorresponding to the user input.

(5) The information processing apparatus of any one of (1) to (4),further comprising: a database that stores an association between firstdata and location information, wherein the processor extracts thelocation information by comparing the user input to the first datastored in the database, and extracts the location information from thedatabase based on a result of the comparison.

(6) The information processing apparatus of any one of (1) to (5),wherein the processor controls the user interface to prompt the user toenter the information at a timing before the captured image data isacquired, while the captured image data is being acquired or after thecaptured image data is acquired based on a predetermined setting.

(7) The information processing apparatus of any one of (1) to (6),wherein the processor controls the user interface to display a graphicindicia indicating whether the location of the information processingapparatus has been detected.

(8) The information processing apparatus of (6), wherein the processorcontrols the user interface to display a graphic indicia indicatingwhether the location of the information processing apparatus has beendetected at the timing before the captured image data is acquired, whilethe captured image data is being acquired or after the captured imagedata is acquired based on the predetermined setting.

(9) The information processing apparatus of any one of (1) to (8),wherein the processor controls the position determining unit to bedeactivated when a remaining amount of power of a battery of theinformation processing apparatus is below a predetermined thresholdvalue, and the processor controls the display to display a graphicindicia indicating the that the location of the information processingapparatus has not been detected when the position determining unit hasbeen deactivated.

(10) The information processing apparatus of any one of (1) to (9),wherein the processor controls the user interface to prompt the user toprovide at least one of a voice input and a text input when it isdetermined that the location of the information processing apparatus hasnot been detected.

(11) The information processing apparatus of (10), wherein the processorcontrols the user interface to display a character input interfaceincluding a software keyboard image when prompting the user to providethe text input.

(12). The information processing apparatus of any one of (1) to (11),wherein the received location information that is extracted based on theuser input includes a plurality of pieces of location information, andthe processor controls the user interface to display the plurality ofpieces of location information.

(13) The information processing apparatus of (12), wherein the processorassociates one of the plurality of pieces of location information withthe captured image data based on a selection of the one of the pluralityof pieces of location information received at the user interface.

(14) The information processing apparatus of any one of (1) to (13),wherein the received location information that is extracted based on theuser input includes a plurality of pieces of location informationcovering a broad range of locations.

(15) The information processing apparatus of (14), wherein the processorperforms an automatic filtering process to select points of interest inthe broad range of locations.

(16) The information processing apparatus of (15), wherein the processorcontrols the user interface to display the selected points of interest.

(17) The information processing apparatus of (16), wherein the processorassociates location information corresponding to one of the selectedpoints of interest with the captured image data based on a selection ofthe one of selected points of interest received at the user interface.

(18) The information processing apparatus of any one of (2) to (17),wherein the processor controls the user interface to display a mapincluding the captured image data at a position corresponding to theacquired location information with which the captured image data isassociated.

(19) A method performed by an information processing apparatus, themethod comprising: acquiring captured image data; determining whether aposition determining unit of the information processing apparatusdetects a location of the information processing apparatus; controllinga user interface to prompt a user to enter information when it isdetermined that a location of the information processing apparatus hasnot been detected; and receiving location information that is extractedbased on a user input received at the user interface in response to theprompt.

(20) A non-transitory computer-readable medium including computerprogram instruction, which when executed by an information processingapparatus, cause the information processing apparatus to perform aprocess comprising: acquiring captured image data; determining whether aposition determining unit of the information processing apparatusdetects a location of the information processing apparatus; controllinga user interface to prompt a user to enter information when it isdetermined that a location of the information processing apparatus hasnot been detected; and receiving location information that is extractedbased on a user input received at the user interface in response to theprompt.

REFERENCE SIGNS LIST

-   10, 11 Imaging apparatus-   12 Optical component-   14 Imaging unit-   15 Control unit-   16 Image display unit-   18 Touch panel-   19 Location information acquisition unit-   20 Operation unit-   21 Shutter button-   22 Mode switch-   23 Audio recording button-   24 Menu button-   25 Operation lever-   26 Recording unit-   28 Voice input unit-   30 Recording medium-   32 Database-   34 Communication unit-   42 Battery icon-   44, 46 GPS icon-   50A to 50C Artificial satellite-   60 Server

The invention claimed is:
 1. A first information processing apparatus,comprising: a control unit configured to: determine a condition thatfirst information of the first information processing apparatus isundetected; acquire captured image data; control a display screen todisplay an information input image based on the acquired captured imagedata, wherein the control of the display screen is based on thedetermination that the first information of the first informationprocessing apparatus is undetected; receive an input based on aninstruction related to the information input image; and extract thefirst information based on the received input, wherein the displayscreen is controlled to set a timing of the input to one of a timingbefore an imaging operation of the captured image data, a timing duringthe imaging operation of the captured image data, or a timing after theimaging operation of the captured image data, wherein a setting screen,displayed on the display screen, comprises a plurality of userselectable items to set the timing of the input, and wherein theplurality of user selectable items comprise a user selectable item toset the timing of the input to the timing during the imaging operationof the captured image data.
 2. The first information processingapparatus of claim 1, further comprising: an imaging unit configured tocapture the image data, wherein the control unit is further configuredto associate the first information with the captured image data.
 3. Thefirst information processing apparatus of claim 1, wherein the controlunit is further configured to: transmit second information correspondingto the instruction to a second information processing apparatus; andreceive third information that is extracted by the second informationprocessing apparatus, wherein the third information is received based onthe second information corresponding to the instruction.
 4. The firstinformation processing apparatus of claim 1, wherein the control unit isfurther configured to control the display screen to display a graphicicon that indicates the first information of the first informationprocessing apparatus is detected.
 5. The first information processingapparatus of claim 1, wherein the control unit is further configured to:deactivate the determination, based on a remaining amount of power of abattery of the first information processing apparatus, wherein theremaining amount of power is below a threshold value; and display agraphic icon that indicates the first information of the firstinformation processing apparatus is undetected, based on thedeactivation.
 6. The first information processing apparatus of claim 1,wherein the control unit is further configured to control the displayscreen to display a character input interface that includes a softwarekeyboard image to provide a text input.
 7. The first informationprocessing apparatus of claim 1, wherein the extracted first informationincludes a plurality of pieces of location information, and wherein thecontrol unit is further configured to control the display screen todisplay the plurality of pieces of location information.
 8. The firstinformation processing apparatus of claim 7, wherein the control unit isfurther configured to select one of the plurality of pieces of locationinformation based on a user operation.
 9. The first informationprocessing apparatus of claim 8, wherein the control unit is furtherconfigured to associate one of the plurality of pieces of locationinformation with the captured image data, based on the selection of oneof the plurality of pieces of location information.
 10. The firstinformation processing apparatus of claim 2, wherein the control unit isfurther configured to control the display screen to display a map thatincludes the captured image data at a position corresponding to thefirst information with which the captured image data is associated. 11.A method, comprising: in an information processing apparatus:determining a condition that information of the information processingapparatus is undetected; acquiring captured image data; controlling adisplay screen to display an information input image based on theacquired captured image data, wherein the controlling of the displayscreen is based on the determination that the information of theinformation processing apparatus is undetected; receiving an input basedon an instruction related to the information input image; and extractingthe information based on the received input, wherein the display screenis controlled for setting a timing of the input to one of a timingbefore an imaging operation of the captured image data, a timing duringthe imaging operation of the captured image data, or a timing after theimaging operation of the captured image data, wherein a setting screen,displayed on the display screen, comprises a plurality of userselectable items to set the timing of the input, and wherein theplurality of user selectable items comprise a user selectable item toset the timing of the input to the timing during the imaging operationof the captured image data.
 12. A non-transitory computer-readablemedium having stored thereon computer-executable instructions that, whenexecuted by an information processing apparatus, cause the informationprocessing apparatus to execute operations, the operations comprising:determining a condition that information of the information processingapparatus is undetected; acquiring captured image data; controlling adisplay screen to display an information input image based on theacquired captured image data, wherein the controlling of the displayscreen is based on the determination that the information of theinformation processing apparatus is undetected; receiving an input basedon an instruction related to the information input image; and extractingthe information based on the received input, wherein the display screenis controlled for setting a timing of the input to one of a timingbefore an imaging operation of the captured image data, a timing duringthe imaging operation of the captured image data, or a timing after theimaging operation of the captured image data, wherein a setting screen,displayed on the display screen, comprises a plurality of userselectable items to set the timing of the input, and wherein theplurality of user selectable items comprise a user selectable item toset the timing of the input to the timing during the imaging operationof the captured image data.